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Abstract 

Background: Two of the most prevalent causes of severe bacterial meningitis in children, Haemophilus influenzae 
type B (Hib) and Streptococcus pneumoniae, are preventable by existing vaccines increasingly available in 
developing countries. Our objective was to estimate the dose-specific effect of Hib and pneumococcal conjugate 
vaccines (PCV) on childhood meningitis mortality in low-income countries for use in the Lives Saved Tool (LiST). 

Methods: We systematically searched and reviewed published vaccine efficacy trials and observational studies 
reporting the effect of Hib or PCV vaccines on organism-specific meningitis, bacterial meningitis and all-cause 
meningitis incidence and mortality among children less than five years old in low- and middle-income countries. 
Data collection and quality assessments were performed using standardized guidelines. For outcomes available 
across multiple studies (>2) and approximating meningitis mortality, we pooled estimates reporting dose-specific 
effects using random effects meta-analytic methods, then combined these with meningitis etiology data to 
determine the preventable fraction of childhood meningitis mortality for inclusion in LiST. 

Results: We identified 18 studies of Hib conjugate vaccines reporting relevant meningitis morbidity and mortality 
outcomes (2 randomized controlled trials [RCTs], 16 observational studies) but few provided dose-specific effects. 
A meta-analysis of four case-control studies examined the dose-specific effect of Hib conjugate vaccines on Hib 
meningitis morbidity (1 dose: RR=0.64, 95% CI 0.38-1.06; 2 doses: RR=0.09, 95% CI 0.03-0.27; 3 doses: RR=0.06, 95% CI 
0.02-0.22), consistent with results from single RCTs. Pooled estimates of two RCTs provided evidence for the effect of 
three doses of PCV on vaccine-serotype meningitis morbidity (RR=0.16, 95% CI 0.02-1.20). We considered these 
outcomes of severe disease as proxy estimates for meningitis mortality and combined the estimates of protective 
effects with meningitis etiology data to provide an estimate of the preventable fraction of childhood meningitis 
mortality with three doses of Hib (38-43%) and pneumococcal conjugate vaccines (28-35%) for use in LiST. 

Conclusions: Few RCTs or vaccine effectiveness studies evaluated the dose-specific impact of Hib and PCV vaccines on 
childhood meningitis mortality, necessitating use of proxy measures to estimate population impact in LiST. Our analysis 
indicates that approximately three-quarters of meningitis deaths are preventable with existing Hib and PCV vaccines. 
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Background 

Meningitis accounts for an estimated 180,000 deaths every 
year in children less than five years of age globally; and 
approximately 20% of survivors experience long-term dis- 
abling sequelae [1,2]. Bacterial pathogens are responsible 
for the majority of severe pediatric meningitis outside the 
neonatal period, and many cases are preventable with 



* Correspondence: hope.l.johnson@gmail.com 

International Vaccine Access Center, Department of International Health, 
Johns Hopkins Bloomberg School of Public Health, 855 Wolfe St, Suite 600, 
Baltimore, MD, USA 



existing conjugate vaccines protective against Haemophi- 
lus influenzae type B (Hib) and Streptococcus pneumoniae 
(pneumococcus) forms of meningitis [3,4] . 

Although Hib and pneumococcal vaccines have been 
available for more than a decade in developed countries, 
they have only recently been made available to children in 
low-income countries through financial support from the 
GAVI Alliance. As of December 2012, nearly all low- 
income GAVI-eligible countries (70/73) now have Hib 
conjugate vaccine included in their national immunization 
programs. The first GAVI-eligible country introduced 
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pneumococcal conjugate vaccine (PCV) in 2009. Since 
2009, 23 other countries have introduced PCV and 26 
have approval for G AVI- supported PCV introductions 
over the next 2 years [5,6]. 

Understanding the effectiveness of Hib and PCV vac- 
cines remains critical to inform decision-making for the 
remaining low- and middle-income countries yet to 
introduce these vaccines into their national immuniza- 
tion programs. Use of the existing evidence on the effec- 
tiveness of Hib and PCV vaccines can also inform input 
parameters for mathematical models such as the Lives 
Saved Tool (LiST) [7], developed by the Child Health 
Epidemiology Research Group (CHERG), to project the 
number of lives saved by scaling up use of these vac- 
cines in the context of other child survival interventions, 
providing important information for program planning. 

In the absence of an existing estimate for meningitis 
mortality, LiST currently uses estimates of the effective- 
ness of Hib and PCV against childhood pneumonia 
morbidity as a proxy. Here we present a systematic 
review and meta-analysis on the effects of Hib and PCV 
vaccines in prevention of childhood meningitis mortal- 
ity, with the intent to update parameters used in LiST 
to model the dose-specific effectiveness of these vaccines 
using consistent and standard methods according to 
CHERG guidelines [8]. 

Methods 

Study identification, selection and abstraction 

We conducted a systematic search of the published 
literature to identify both trials and observational studies 
reporting on the effect of Hib or PCV vaccines on menin- 
gitis-related morbidity and mortality outcomes among 
children less than five years old in low- and middle- 
income countries [9] published between 1990 and 
December 2010. Search terms included various combina- 
tions of terms for pneumococcal vaccine, Haemophilus 
vaccine, and meningitis and used controlled vocabulary 
where possible (Figure 1). Databases searched include 
Pubmed, Embase, Web of Science, Scopus, Africa- Wide 
Information, Global Health, Cochrane, and the WHO 
Library database (WHOLIS) and WHO regional data- 
bases (Index Medicus for the Eastern Mediterranean 
Region, Western Pacific Region Index Medicus, African 
Index Medicus, IndMed, PAHO Virtual Health Library, 
and Latin America and Caribbean Health Sciences Litera- 
ture (LILACS). We also searched the System for Informa- 
tion on Grey Literature in Europe (SIGLE) and websites 
including http://ClinicalTrials.gov, Hibaction, PneumoA- 
DIP, and the World Health Organization Hib and Pneu- 
mococcus for relevant citations [4,10,11]. 

All studies with data from only high-income countries 
were excluded. We double-reviewed the titles and abstracts 
of the remaining citations. The full-text of included citations 



was retrieved where possible and double-reviewed for inclu- 
sion with discrepancies resolved by consensus between 
reviewers. We excluded animal, in-vitro and immunogeni- 
city studies, those without primary data on outcomes of 
interest, time-series observational studies with only post- 
vaccine introduction data, and studies conducted among 
vulnerable populations not representative of the general 
population. We included randomized controlled trials 
(RCTs), cohort and observational studies (case-control and 
pre- vs. post-vaccine introduction time periods) that 
assessed use of Hib or PCV vaccines and the effect on Hib 
or PCV-specific meningitis, bacterial or probable bacterial 
meningitis according to authors' case definition (typically, 
according to WHO criteria on CSF findings [12]), or 
all-cause meningitis incidence or mortality or all-cause 
mortality among children less than five years of age in low- 
or middle-income countries, if the study design included a 
control group (or time period in the instance of pre- vs. 
post vaccine introduction time-series studies) and standard 
error information was available. For studies evaluating the 
effectiveness of PCV s, we also abstracted vaccine serotype- 
specific (VT) and all-serotype (AT) outcomes. Foreign 
language articles were reviewed by proficient abstractors or 
translated where possible. In instances where the same out- 
come was reported from multiple citations studying the 
same or overlapping study populations, we selected only the 
publication with the most complete or recent results for 
inclusion. 

We double-abstracted information about the study 
location, design, population characteristics and size, type 
of vaccine, and immunization coverage directly into a 
customized Microsoft Access database (Microsoft). All 
included studies were independently abstracted and har- 
monized by consensus, then re- confirmed by a senior 
adjudicator. For outcomes of interest we abstracted 
information on the number of events in the control (or 
pre-introduction) and intervention (or post-introduc- 
tion) groups, effect measures (risk ratios, RR) and stan- 
dard error information by numbers of doses of vaccine 
administered. All effect estimates were converted into 
RR where otherwise presented and 95% confidence 
intervals calculated from available information in the 
publication and population data from national [13] and 
United Nations [14] statistical sources when necessary. 

For pre- vs. post-vaccine introduction time-series stu- 
dies, the effect measure was typically calculated by com- 
paring number of events occurring in the last year prior 
to vaccine introduction (pre-introduction) to number of 
events in the last year for which data are available post- 
vaccine introduction (post-introduction). When available, 
immunization coverage data informed categorization of 
years into these time periods. Results were sometimes 
available from the same setting for both pre- vs. post- 
introduction and nested case-control study designs, and 
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Strategy: Citations are identified that contain text in the Title/ Abstract/Keywords fields 
using the following strategy/search term group. Case Reports, Animal Studies, Reviews 
and Systematic Reviews were excluded where search engines allowed. 

(Search Group 1 ) AND Search Group 2 AND (Search Ciroup AND 

Date Range (1 January 1990-15 December 20 1 0) 



Search Group 1: Vaccine Terms 

"heptavalent pneumococcal conjugate vaccine" [MeSH] OR "five-valent pneumococcal 
conjugate vaccine" [MeSH] OR "PncOMPC vaccine" [MeSH] OR PNCRM7 [All Fields] 
OR "OMPC conjugate vaccine" [All Fields] OR PncOMPC [All Fields] OR 
"pneumococcal conjugate vaccine" [All Fields] OR "pneumococcal conjugate vaccines" 
[All Fields] OR "prevnar" [All Fields] OR "prevenar" [All Fields] OR PCV7 [All Fields] 
OR PCVIO [All Fields] OR PCV2 [All Fields] OR PCV4 [All Fields] OR PCV5 [All 
Fields] OR PCV7 [All Fields] OR PCV8 [All Fields] OR PCV9 [All Fields] OR PCVIO 
[All Fields] OR PCVl 1 [All Fields] OR PCVI3 [All Fields] OR "haemophilus vaccines" 
[MeSH] OR "haemophilus conjugate vaccine" [All Fields] OR "haemophilus conjugate 
vaccines" [All Fields] OR "hemophilus conjugate vaccine" [All Fields] OR "haemophilus 
conjugate vaccine" [All Fields] OR "haemophilus vaccine" [All Fields] OR hemophilus 
vaccine" [All Fields] OR "haemophilus vaccines" [All Fields] OR "hemophilus vaccines" 
[All Fields] OR "H. influenzae vaccine" [All Fields] OR "H. influenzae vaccines" OR 
"haemophilus influenzae vaccine" [All Fields] OR "hemophilus influenzae vaccine" OR 
"haemophilus influenzae vaccines" [All Fields] OR "hemophilus influenzae vaccines" OR 
"ActHib" [All Fields] OR "PedVaxHib" [All Fields] OR "Comvax" [All Fields] OR 
"DTaP/Hib" [All Fields] OR "TriHlBit" [All Fields] OR "DTPw-HB/Hib" [All Fields) 
OR "tritanrix" [All Fields] OR "hiberix" [All Fields] OR hibtiter [All Fields) OR 
HbOC |AII Fields) OR "PRP-D" )AII Fields) OR "PRP-T" )AII Fields) OR "PMP- 
OMP" )A1I Fields] 

Search Group 2: Disease Temis 

"Meningitis, Bacterial"[Mesh] OR ("meningitis"[All Fields] AND "bacterial"[AII Fields]) 
OR "Meningitis, Meningococcar'[Mesh] OR ("meningitis"[All Fields] AND 
"meningococcar'[AII Fields]) OR "meningococcal infections"[MeSH Terms] OR 
("meningococcal"[All Fields] AND "infections" [All Fields]) OR ("meningitis"[All Fields] 
AND "infection"[All Fields]) OR ("meningitis"[All Fields] AND "infections" [All Fields]) 
OR ("meningococcal" [all fields] AND "infection"[All Fields]) OR "Waterhouse- 
Friderichsen Syndrome" [Mesh] OR "Meningitis, Pneumococcal" [Mesh] OR 
("pneumococcar'[All Fields] AND "meningitis"[All Fields]) OR "Meningitis, 
Haemophilus "[Mesh] OR ("haemophilus"[All Fields] AND "meningifis"[All Fields]) OR 
("hemophilus"[All Fields] AND "meningitis"[All Fields]) 



Search Group 3: Child Terms 

"Child"[Mesh] OR "Child"[All Fields] OR "Children"[All Fields] OR "Childhood"[All 
Fields] OR "neonate" [All Fields] OR "infant" [All Fields OR "pediatric" [All Fields] 
OR "paediatric" [All Fields] 



Figure 1 PubMed literature search terms 



in these instances the case-control data were used in the 
analysis. For RCTs, age of the study population indicates 
age at time of enrollment recruitment. 

Qua)ity assessment and effect size estimates for LiST 

We assessed the generalizability and quality of evidence 
using the CHERG scoring system [8]; the Cochrane Colla- 
boration's GRADE criteria [15] for determining risk of 
bias were used to guide score assignment for RCTs; and 
the Newcastle-Ottawa Quality Assessment Scale [16] was 
used to inform quality assessment for non-randomized 



studies in meta-analyses. Due to the severity of meningitis, 
in which virtually all diagnosed cases are hospitalized, 
population generalizability was not downgraded for studies 
ascertaining only hospitalized cases. Details of study data 
quality scoring, including inclusion in relevant Cochrane 
reviews [10,11] are presented in Supplementary Tables 1 
and 2 in Additional File 1. 

We log-transformed study effect measures (RR), strati- 
fied analyses by study design (RCT, case-control, pre- 
post-introduction) and number of vaccine doses for out- 
comes, and pooled estimates with more than one study 
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available in a stratum. Meta-analysis of effect measures 
was conducted using the DerSimonian-Laird pooled risk 
ratio to provide conservative estimates in the presence 
of heterogeneity and presented with a 95% confidence 
interval (CI). All analyses were performed using STATA 
software (version 12.1, Stat Corp, College Station, TX). 
Sensitivity analyses included pooling studies with exact 
number and greater number of doses (i.e. combined 
effects of 1 dose with those of > 1 doses), restricted age 
groups, multi-year post-introduction time periods 
(rather than single years), and apparent elimination (i.e. 
zero events) in the post-introduction time period in 
time-series studies. 

LiST projects the impact of child survival interven- 
tions on syndrome-specific causes of child mortality. To 
provide an effect size estimate for inclusion in LiST, we 
pooled estimates across multiple studies (>2) of the 
same design reporting dose-specific effects for outcomes 
approximating meningitis mortality, then combined 
these with meningitis etiology data from existing reviews 
[17,18] to determine the Hib and PCV vaccine preventa- 
ble fractions of childhood meningitis mortality. We 
computed 1,000 Monte Carlo simulations for each para- 
meter given a triangular distribution and uncertainty 
limits determined by the 95% uncertainty interval for 
each of the parameters (i.e. proportion of meningitis 
caused by Hib or PCV, vaccine effectiveness and for 
PCV the vaccine serotype coverage.) Multiplying these 
simulated parameters and using the resulting distribu- 
tion of vaccine attributable fractions, we took the 2.5th 
and 97.5th percentile as the approximate central 95% 
uncertainty interval. The estimated values for meningitis 
etiology, vaccine serotype coverage and vaccine preven- 
table fractions of childhood meningitis mortality are for 
illustrative purposes and can be modified by LiST users. 

Results 

Studies identified 

The systematic literature review yielded 3599 unique 
citations from Pubmed and 1267 non-deduplicated cita- 
tions from other sources (Figure 2), of which 20 con- 
tained abstractable data on the effects of Hib conjugate 
vaccines («=18) and PCVs («=2) in prevention of 
meningitis outcomes or all-cause mortality in low- and 
middle-income countries. Eligible citations were fre- 
quently excluded in full-text screening due to reporting 
of overlapping data with another citation, lack of a 
clearly-defined population for catchment area, or failure 
to meet analytic criteria due to lack of standard error 
information [19-45]. 

Quality assessment and IHib vaccine effects 

The 18 included studies reported the effects of Hib- 
containing conjugate vaccines including PRP-tetanus 



toxoid (PRP-T) or PRP-diphtheria toxoid (PRP-CRM), 
alone or mixed with other antigens. Characteristics and 
outcomes from included studies are summarized in 
additional file. Table 3. Note that this table is in the 
additional file as it was too large to present in the docu- 
ment. Our primary objective was to estimate the effects 
of Hib conjugate vaccines on childhood meningitis mor- 
tality; we identified a single RCT [46] from Indonesia 
reporting the effects on all-cause meningitis mortality 
(RR: 0.87, 95% CI: 0.32-2.41), but it cannot be included 
in LiST as CHERG guidelines require >2 studies for an 
effect. Similarly, a single RCT [46] (RR: 0.11, 95% CI: 
0.01-1.17) and a very-low-quality case-control study [47] 
(RR: 0.29, 95% CI: 0.06-1.37) reported non-statistically 
significant reductions in risk of Hib meningitis mortal- 
ity. Also, evidence on the effect of at least one dose of 
Hib conjugate vaccine on all-cause mortality was avail- 
able from RCTs in Indonesia [48] and The Gambia [46], 
yielding a pooled estimate of a 4% reduction in all-cause 
mortality (RR: 0.96, 95% CI: 0.86-1.08), but since LiST 
models syndrome-specific intervention effects, this out- 
come is not recommended for the effect estimate. 

More evidence of the effects of Hib conjugate vaccines 
was available for meningitis morbidity outcomes. Observa- 
tional studies of the effects of Hib conjugate vaccines on 
meningitis outcomes included case-control studies of Hib 
vaccine effectiveness («=6) and time-series analyses com- 
paring outcomes pre- and post-Hib vaccine introduction 
often using surveillance data (k=9). A majority of the case- 
control studies were from African countries («=4) while 
most time-series analyses were conducted in Latin America 
and Caribbean countries (k=7). The evidence of the effects 
of Hib on meningitis outcomes was limited in the Asia 
(1 RCT, 1 case-control study) and Oceania (1 time-series 
analysis) regions. Three studies, including a single RCT 
[48] (RR=0.50, 95% CI: 0.27-0.82) and two pre-post vaccine 
introduction time-series analyses [49,50] (RR=0.70, 95% CI: 
0.54-0.89) estimated the overall effect of Hib conjugate vac- 
cine on incidence of all-cause meningitis. A single RCT 
[48] and six observational studies (case-control and time- 
series analyses) [49-54] provided very-low-to-moderate 
quality evidence on the effect of Hib vaccine on incidence 
of acute bacterial or probable bacterial meningitis. 

Thus, although our primary interest was to estimate 
dose-specific effects of Hib conjugate vaccine on menin- 
gitis mortality, sufficient evidence was available only for 
Hib meningitis morbidity outcomes. Thirteen of the 
observational studies reporting morbidity outcomes 
[49-61], of very-low-to-moderate quality, estimated 
effects on Hib meningitis incidence, but dose-specific 
effects were only available from the subset that were 
case-control studies (Figure 3). Our meta-analysis of the 
four pooled case-control studies examined the dose- 
specific effect of Hib conjugate vaccines on Hib meningitis 
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Additional records identified 
through other sources* 
(n =1267) 



PCV Articles appropriate for 
meta-analysis (n=2) 



.All-cause meningitis morbidity 

(n=l) 



All-cause mortalit> 
(n = 2) 



S. piiettmoitiue meningitis 
morbidity, all-type (n = 2) 



S. pneumoniae meningitis 
morbidity, vaccine-type (n = 2) 



Records identified through 
Pubmed database search 
(n = 3599) 



Articles passing title/abstract screening 
(n = 276) 



Articles appropriate for 
abstraction (n = 48) 



Hib Articles appropriate for meta- 
analysis (n = 18)** 



All-cause meningitis morbidity 

(n = 3) 



All-cause meningitis mortality 
(n=l) 



All-cause mortality 
(n = 2) 



Bacterial meningitis morbidity 
(n = 8) 



Hib meningitis morbidity 
(n = 17) 



Hib meningitis mortality 

(n = 4) 



^ Developed world data only (n= 57) 



^ Immunogenicity data only (n = 89) 



No primary data (n= 26) 



Non-human study (n=l9) 



No PCVVHib vaccine intervention 

(n= 10) 



Other (n= 27) 
(E.g, no control arm; duplicate 
article; predates 1980) 



Hib Articles with abstractable 
outcomes not appropriate for 
meta-analysis: 

lack of standard error 
information, or 
superseded by other study 
from similar setting (n = 28) 



* Exclusion details not provided because excluded 
articles from other sources were not initially de- 
duplicated prior to title and abstract screening. 

** Outcomes do not sum to 1 8 studies due to 
studies reporting multiple outcomes. 

Figure 2 Flow chart of studies reporting the effect of Hib or pneumococcal conjugate vaccines on meningitis outcomes. 



morbidity (1 dose: RR=0.64, 95% CI 0.38-1.06; 2 doses: 
RR=0.09, 95% CI 0.03-0.27; 3 doses: RR=0.06, 95% CI 
0.02-0.22); and these estimates were consistent with results 
from three doses of Hib vaccine administered in two RCTs 
[46,48] (pooled RR: 0.12, 95% CI: 0.03-0.51) and the 
pooled estimate across time-series studies evaluating pre- 
vs. post-Hib introduction (RR: 0.02; 95% CI: 0.00-0.15). 

Quality assessment and PCV vaccine effects 

We identified only two studies, both high-quality RCTs 
among children age 1-30 months from South Africa [62] 
and The Gambia [63], reporting the effects of PCV on 



meningitis-related outcomes. The overall reduction in 
all-cause mortality associated with at least one dose of 
the nine-valent vaccine (PCV-9) was 10% across studies, 
(pooled RR=0.90, 95% CI: 0.80-1.01), but as above, all- 
cause mortality cannot be used for LiST. An estimate of 
all-cause meningitis mortality reduction with three 
doses of PCV-9 was only available from the South Afri- 
can RCT (RR: 0.87, 95% CI: 0.32-2.41). Finally, both 
RCTs also reported evidence on the effects of three 
doses of PCV-9 on pneumococcal meningitis morbidity. 
Although the findings indicate non-statistically signifi- 
cant reductions in incidence of AT pneumococcal 
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Hib meningitis morbidity-1 dose Hib conjugate vaccine, Case-Control 
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B) 



Hib meningitis mott)idity-2 doses Hib conjugate vaccine, Case-Control 
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Hib meningitis morbidity-3 doses Hib conjugate vaccine, Case-Control 
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Figure 3 Meta-analysis of observational studies examining the effect of Hib conjugate vaccines on Hib tneningitis incidence by: A) 1 dose, B) 2 
doses, C) 3 doses of vaccine. 



meningitis (pooled RR=0.88, 95% CI: 0.47-1.62) and to Effect size estimates for inclusion in LiST 

VT meningitis in particular (pooled RR=0.16, 95% CI: Using the CHERG grading system to provide recom- 

0.02-1.20), the direction and magnitude of the effects mendations on evidence to be used to estimate the 

were similar across both RCTs (Table 1, Figure 4). effect sizes for inclusion in LiST, we only found 



Table 1 Studies of the effect of pneumococcal conjugates vaccines with meningitis outcomes. 



Quality Assessment 




Directness 




Effect 






No of Doses Design 
studies 


Limitations 


Consistency 


Generalizability to 
Population of Interest 


Generalizability to 
Intervention of Interest 


Age range 
(months) 


Events (control or 
pre-lntroduction) 


Events (intervention or 
post-introduction) 


Measure or 

Meta- 
estimate 


All-cause meningitis morbidity: High -quality measure of outcome-specific mortality 


1 [62] 3 doses RCT 


High quality- 
None major 


Not applicable 


moderate-Africa 


moderate-1 vaccine 
(PCV-9) 


1-30 


8 


7 


0.87(0.32-241) 


All-cause mortality 


2 1 dose RCT 
[62,63] 3 doses 
(goal) 


High quality- 
None major 


high-evidence of 
dose-response effect 


high-Africa 


moderate-1 vaccine 
(PCV-9) 


1-30 


389 
242 


330 
229 


0.90(0.80- 
1.01) 


SP Meningitis, All-serotypes 


2 3 doses RCT 
[62,63] 3 doses 
(goal) 


High quality- 
None major 


high-consistent 
effect magnitude 


high-Africa 


moderate-1 vaccine 
(PCV-9) 


1-30 


17 

6 


19 

5 


0.88(0.47- 
1.62) 


SP Meningitis, Vaccine-serotypes 


2 3 doses RCT 
[62,63] 3 doses 
(goal) 


High quality- 
None major 


moderate-consistent 
direction of effect 


high-Africa 


moderate-1 vaccine 
(PCV-9) 


1-30 


18 

6 


2 
1 


0.16(0.02- 
1.20) 
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SP Meningitis, Vaccine-serotypes-3 doses PCV-9, RCT 



RR(S5%CI} WaigM 



Cutis. The Gambia. 2005 (1 -30fDO) 



Klugman. Soulh Africa. 2003 (1 -30 mo) 



Overall (l-sriuarao = 0.0%. p 0.833) 



NOTE; Welghls are teom ranrlonl alfects analysis 




O06 (0.00. 066) 



017(0.02. 1.38) 



016(0.02.1.20) 100.00 



Figure 4 Meta-analysis of ran(domized controllecJ trials (RCTs) examining the effect of three doses of pneumococcal conjugate vaccine on 
incidence of vaccine-type (VT) pneumococcal meningitis. 



sufficient data to estimate dose-specific effects of Hib 
conjugate vaccines for the Hib meningitis morbidity out- 
come. For Hib conjugate vaccines, evidence reported for 
the effect on all-cause mortality, all-cause meningitis 
mortality, all-cause and acute bacterial meningitis mor- 
bidity were available from single or multiple studies of 
varying study designs and different numbers of doses (e. 
g. at least 1 dose or 3 doses) but dose-specific evidence 
was only available for each dose (1, 2, and 3 doses sepa- 
rately) from case-control observational studies evaluat- 
ing the effects on Hib meningitis incidence. 

Ideally, dose-specific effects should be estimated using 
the same studies for each dose number, to reduce the 
probability that the differential impact observed between 
doses is due to inclusion of different studies rather than 
actual differences between doses. We identified four case- 
control studies reporting the dose-specific effects of Hib 
conjugate vaccine on incidence of Hib meningitis, per- 
formed sensitivity analyses including evidence from other 
studies for which all dose-specific effects were not available, 
and retained these other studies in the pooled estimates if 
inclusion resulted in little or no impact on the effect mea- 
sure. This measure of the protective effect of Hib conjugate 
vaccines on incidence of Hib meningitis was assumed to 
approximate the effects on Hib meningitis mortality. 



Since LiST models the effects of interventions on syn- 
drome-specific child mortality, we then combined the 
pooled effects on Hib meningitis with meningitis etiol- 
ogy data (i.e. proportion of meningitis due to Hib) to 
determine the preventable fraction of childhood menin- 
gitis mortality for inclusion in LiST as seen in Table 2. 
We used meningitis etiology data from an existing 
CHERG review [64] for illustrative purposes; the value 
can be re-calculated with other source data and entered 
by the LiST user. These combined data provide an esti- 
mated dose-specific effect of Hib conjugate vaccines on 
childhood meningitis mortality in low-and middle- 
income countries ranging from a 14%, 36% and 38% 
reduction in a meningitis belt setting with 1, 2 and 3 
doses, respectively, and 17%, 42% and 43% reduction 
elsewhere. 

With respect to PCVs, two high-quality RCTs reported 
the effects of PCV -9 on both all-cause mortality and pneu- 
mococcal meningitis in low-income countries. As above, 
because LiST does not model the effect of childhood inter- 
ventions on all-cause mortality, we used the pooled esti- 
mate of the effects of 3 doses of PCV-9 against vaccine- 
type pneumococcal meningitis, combined with meningitis 
etiology data (proportion of meningitis due to pneumo- 
coccus) and vaccine serotype coverage (proportion of 
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Table 2 Effect size estimates of IHib conjugate vaccines on childhood meningitis mortality for inclusion in LiST. (A) 
Approximated using evidence from existing reviews and can be edited by the LiST user. (B) Estimate of the 
effectiveness of Hib vaccines against IHib meningitis mortality (risk ratio) from this review. (C) Effect size for Hib 
conjugate vaccines on meningitis mortality for LiST calculated by multiplying (A) x (B). (D) Uncertainty bounds. 
tEffectiveness of Hib vaccines against Hib meningitis mortality is approximated by incidence of Hib meningitis 
disease. 



Proportion of all-cause meningitis 
mortality due to Hib [1] 
(A) 


Effectiveness of Hib vaccines against Hib 
meningitis mortality 
(risk ratio)t(B) 


Effect size for Hib vaccine on 
meningitis mortality 
(A X B) = (C) 


Uncertainty 
bounds 
(D) 


African meningitis belt 


1 0.40 (0.30-0.52) 

dose 


0.36 (0.0-0.62) 


0.14 


0.03-0.20 


2 0.40 (0.30-0.52) 
doses 


0.91 (0.73-0.97) 


0.36 


0.27-0.41 


3 0.40 (0.30-0.52) 

doses 


0.94 (0.78-0.98) 


0.38 


0.29-0.42 


Other regions 


1 0.46 (0.40-0.54) 

dose 


0.36 (0.0-0.62) 


0.17 


0.03-0.22 


2 0.46 (040-0.54) 
doses 


0.91 (0.73-0.97) 


0.42 


0.34-045 


3 0.46 (040-0.54) 


0.94 (0.78-0.98) 


0.43 


0.36-0.46 



doses 



pneumococcal meningitis caused by vaccine serotypes 
approximated from invasive pneumococcal disease) from 
existing reviews [65,66] to provide an estimated effect of 
PCV on childhood meningitis mortality in low-and mid- 
dle-income countries. Applying this approach to an exam- 
ple using the existing 10-valent PCV (PCV-10), we 
estimated region-specific effects ranging from 28-35% 
reduction in childhood meningitis mortality with 3 doses 
of PCV-10 (Table 3). Use of the existing thirteen-valent 
PCV (PCV-13) would likely increase the effect size. 



Discussion 

Lack of dose-specific estimates on the effects of Hib and 
PCV on childhood meningitis mortality from high-quality 
studies (e.g. RCTs) complicated the quantification of effect 
sizes to be incorporated into LiST. Additionally, existing 
CHERG guidelines are more easily applied to interventions 
with a single coverage stratum (e.g. coverage with 3 doses 
of vaccine) rather than dose-specific effects (e.g. coverage 
with 1, 2 and 3 vaccine doses) which require evidence for 
the effect of each dose across multiple studies. 



Table 3 Effect size estimates of pneumococcal (SP) conjugate vaccines (PCV) on childhood meningitis mortality for 
inclusion in LiST. (A) Approximated using evidence from existing reviews and can be edited by the LiST user [1]. (B) 
Approximated from the proportion of invasive pneumococcal disease caused by vaccine serotypes In the existing 10- 
valent PCV from an existing review and can be edited by the LiST user [1 7]. (C) Estimate of the effectiveness of PCV 
against vaccine-serotype SP meningitis mortality (risk ratio) from this review. (D) Effect size for PCV on meningitis 
mortality for LiST calculated by multiplying (A) x (B) x (C). (E) Uncertainty bounds. 

Proportion of all-cause Proportion of SP meningitis Effectiveness of PCV against Effect size for PCV on Uncertainty 

meningitis mortality due to caused by vaccine serotypes vaccine-type SP meningitis meningitis mortality bounds 

SP [1,18] (B) mortality (A x B x C) = (D) (E) 
(A) (C) 



African 
meningitis 

belt 


0.46 (0.42-0.50) 


0.72 (0.67-0.76) 


0.84 (0.00-0.98) 


0.28 


0.05-0.30 


Africa non- 
meningitis 
belt 


0.52 (047-0.58) 


0.72 (0.67-0.76) 


0.84 (0.00-0.98) 


032 


0.05-0.34 


Asia 


0.52 (0.47-0.58) 


0.70 (0.64-0.75) 


0.84 (0.00-0.98) 


0.31 


0.05-0.33 


Europe 


0.52 (047-0.58) 


0.81 (078-0.82) 


0.84 (0.00-0.98) 


035 


0.06-0.38 


Latin America 
and Caribbean 


0.52 (047-0.58) 


0.77 (0.74-0.80) 


0.84 (0.00-0.98) 


0.34 


0.06-0.36 


Oceania 


0.52 (047-0.58) 


0.75 (0.63-0.84) 


0.84 (0.00-0.98) 


033 


0.06-0.35 
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Despite the limited number of RCTs evaluating the 
effects of Hib conjugate vaccine on childhood meningitis 
mortality, we identified considerable evidence from 
observational studies, both case-control and time-series 
pre- and post-vaccine introduction, and across a range 
of meningitis outcomes, with relative consistency 
observed across study designs and settings. We also per- 
formed a series of sensitivity analyses including studies 
with restricted age ranges and different numbers of vac- 
cine doses (e.g. effects of exactly 3 doses combined with 
those of 3 or more doses), and the effect on incidence 
of Hib meningitis appeared robust in sensitivity analyses. 

For comparison, we assessed our findings with those 
from two recent global reviews measuring the efficacy of 
Hib vaccine against invasive Hib disease in a meta-analysis 
of RCTs by Griffiths et al. [67], and a review of observa- 
tional studies by Jackson et al.[68] Among studies from 
developing countries [69] we included in our analyses the 
same studies with the exception of those lacking either 
clearly defined populations or sufficient information to 
calculate standard error.^^[70] Despite these slight differ- 
ences in included studies, and in specificity of outcome of 
interest, these two reviews reported pooled estimates of 
Hib conjugate vaccine efficacy against invasive Hib disease 
consistent with our estimates. We identified limited data 
available for PCV from observational studies or other 
reviews to allow for a similar assessment of the consis- 
tency of our results, but this will be possible when PCV 
impact assessments from early adopting low-income coun- 
tries become available in the near future. 

These estimates, as may be true of LiST estimates for 
some other vaccines, probably significantly underesti- 
mate the population-wide impact of the interventions. 
The impact measures used for the LiST estimates pro- 
vided here reflect the indirect or herd effect minimally if 
at all (as they are based on case-control studies and 
RCTs) and LiST does not currently incorporate indirect 
effects into projections. However, its importance is well- 
documented in empirical studies in developed countries 
[71-76], and would be expected to be significant for 
populations both within and beyond the age groups 
modeled in LiST. 

Several other limitations may affect these estimates as 
well, including the quality and comparability of studies 
in the analysis and the assumptions required to quantify 
an effect size for inclusion in LiST. Higher-quality data 
was available for some Hib outcomes but these either 
were from single studies or did not provide dose-specific 
effect estimates. While there was some data from most 
regions, there was not sufficient data to provide region- 
specific estimates of the effects of Hib or PCV vaccines 
on meningitis. The generalizability of the two PCV stu- 
dies, particularly for the South African trial limited to 



hospitalized children, is not clear. Incomplete documen- 
tation of vaccination status in case-control studies, and 
of immunization coverage for time-series impact assess- 
ments, could also have biased results. Indirect effects 
may provide an important contribution to vaccine 
impact, but no data were available for PCV and LiST 
does not currently model the impact of indirect effects 
of interventions. Future versions of LiST may be able to 
incorporate estimates of both direct and indirect effects 
of interventions. 

In addition to the limitations of the vaccine efficacy or 
effectiveness data, the assumptions and approximations 
required to be able to quantify the dose-specific effects of 
Hib and PCV vaccines provide additional uncertainty in 
the results. First, we assumed that vaccine effects on inci- 
dence of Hib meningitis and vaccine-type pneumococcal 
meningitis approximate effects on organism-specific child- 
hood meningitis mortality. Bacterial meningitis typically 
causes severe disease and with a high case fatality ratio, 
therefore this assumption is plausible. Second, we used 
meningitis etiology data from an existing review [77] to 
estimate the proportion of meningitis due to Hib or pneu- 
mococcus. Third, for PCV, we assumed that vaccine cov- 
erage of serotypes causing invasive pneumococcal disease 
from a recent review [78] was equivalent to coverage of 
serotypes causing pneumococcal meningitis mortality; this 
may not be completely accurate, since most IPD cases are 
due to bacteremic pneumonia, and syndrome-specific ser- 
otype differences between syndromes have been reported 
[79] . The assumed values of vaccine-preventable fractions 
of childhood meningitis mortality were for illustrative pur- 
poses using available evidence, and can be changed by the 
LiST user if higher-quality or more representative data are 
available for individual country projections. The multipli- 
cation of multiple parameters to estimate the vaccine- 
preventable fraction of meningitis mortality increases the 
degree of uncertainty. However, we are encouraged by the 
consistency of our findings with results from single RCTs 
and observational studies from other similar reviews. The 
results of this analysis suggest that 3 doses of Hib and 
PCV together would prevent approximately three-quarters 
of childhood meningitis mortality, leaving a remaining 
one-quarter caused by non-vaccine type pneumococcal 
meningitis, meningococcal meningitis and other causes of 
meningitis/encephalitis. 

Conclusions 

Estimates of the dose-specific effectiveness of PCVs and 
Hib conjugate vaccines in preventing childhood menin- 
gitis mortality are limited by sparse data that met the 
criteria for our meta-analysis, including high quality 
prospective studies in low income settings. Despite these 
limitations, available evidence on impact of these 



Davis ef al. BMC Public Health 2013, 13(Suppl 3):S21 
httpy/www.biomedcentral.coni/1471-2458/13/S3/S21 



Page 11 of 13 



vaccines on meningitis morbidity indicates that a major- 
ity of childhood meningitis mortahty is preventable with 
existing Hib and PCV vaccines, and these findings are 
consistent with other empirical evidence and reviews. 
Our understanding of the impact of PCV in low-income 
settings is likely to significantly improve over the next 
several years as results from early PCV adopting coun- 
tries are made publicly available. Inclusion of dose- 
specific and indirect effects of interventions will likely 
improve the accuracy of LiST country impact projections. 

Key messages 

Available evidence indicates that a majority of childhood 
meningitis mortality is preventable with existing Hib 
and PCV vaccines and these findings are consistent with 
other empirical evidence and reviews. This review quan- 
tified the effects of Hib and pneumococcal conjugate 
vaccines and will be incorporated into the Lives Saved 
Tool (LiST) to model the projected impact on childhood 
meningitis mortality in low income countries. 

Additional material 



Additional File 1: Supplementary Tables 1,2 and 3 Supplementary 
Table 1 (sheet 1): Complete data on included Hib studies. Supplementary 
Table 2 (sheet 2): Compete data on included PCV studies. Supplemental 
Table 3: Data from final Hib studies used in effect size estimation. 
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